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I 

SUMMARY 


This  is  a progress  report  on  research  carried  out  under  the 
sponsorship  of  the  Air  Force  Office  of  Scientific  Research  under 
Grant  #AF-AFOSR-71-2078D  for  the  period  June  1,  1975  to  May  31,  1976. 

The  research  accomplished  during  this  period,  as  well  as  con- 
tinuing research,  is  outlined  in  Section  11.  Section  111  gives  the 
appropriate  references,  whereas  publications  resulting  from  this 
grant  during  the  reporting  period  are  given  in  Section  IV.  Publica- 
tions by  other  members  of  the  Center  which  relate  to  this  research 
are  given  in  Section  V. 

The  research  carried  out  during  this  period  can  be  divided 
into  six  interrelated  areas  which  arise  in  the  study  of  control 
systems . 

1)  Linear  Multivariable  Systems 

2)  Adaptive  Control  Systems 

3)  Bilinear  Systems 

4)  Stochastic  Systems 

5)  Systems  that  give  rise  to  Bifurcations 

6)  Systems  governed  by  Ordinary  and  Functional  Differential 
Equations . 

These  research  accomplishments  are  briefly  outlined  below; 
Section  11  gives  a fuller  description  of  these  results. 

Professor  Wolovich  and  his  students  have  studied  the  problem 
of  arbitrarily  assigning  closed  loop  poles  of  a linear  multivariable 
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systems  developing  a new  method,  a generalization  of  the  classical 
root  locus  method.  Studies  have  also  been  conducted  of  the  attain- 
ment of  stable  solutions  of  model  matching  problems.  Wolovich  has 
recently  published  a survey  of  recent  contributions  made  utilizing 
the  differential  operator  approach,  in  contrast  to  the  state-space 
approach,  in  the  analysis  and  synthesis  of  linear  multivariable 
systems . 

Professor  Pearson  and  his  students  have  developed  a technique,' 
based  on  a modified  minimum  energy  regulator  problem,  to  obtain  feed- 
back stabilization  of  linear  time  varying  differential  systems. 
Professor  Pearson  has  also  developed  two  methods  of  parameter  identi- 
fication for  linear  differential  systems. 

Using  a development  in  system  identification,  Pearson  has 
developed  identification  techniques  applicable  to  a class  of  parameter 
adaptive  control  systems.  He  has,  with  a student,  studied  bilinear 
control  systems  vrith  particular  applications  to  parachute  gliding 
systems  and  the  pursuit-evasion  missile  control  problem. 

Professors  Falb  and  Wolovich  have  pursued  studies  of  linear 
operator  feedback  for  the  compensation  and  control  of  multivariable 
systems . 

Professor  Kushner  has  developed  a number  of  computational 
methods  and  techniques  for  control  problems  with  diffusion  models; 
these  results  are  presented  in  a forthcoming  monograph.  He  has  also 
continued  his  study  of  the  application  of  Monte  Carlo  methods  for  the 
optimization  of  constrained  noisy  systems. 

Professor  Fleming  has  recently  coauthored  a book  on  det.erminis- 


tic  and  stochastic  optimal  control  [1];  he  has  also  studied  the 
concept  of  generalized  solutions  for  optimal  stochastic  control 
problems . 

The  study  of  bifurcation  problems  has  been  pursued  by  Pro- 
fessor Hale  and  his  students,  both  from  the  abstract  viewpoint  and 
for  specific  applications,  such  as  the  von  K£rm£n  equations  for 
plates  and  the  Duffing  equation  for  nonlinear  oscillations. 

Professors  Banks,  Hale  and  LaSalle  have  continued  their 
studies  of  systems  described  by  ordinary  and  functional  differential 
equations.  Professor  Hale  and  students  have  studied  the  stability 
invariance  of  functional  differential  equations  with  respect  to 
changes  in  the  delays.  Professor  Banks  has  studied  the  problem  of 
developing  approximation  techniques  for  linear,  bilinear  and  weakly- 
nonlinear  systems  with  delays.  Professor  LaSalle  has  pursued  studies; 
of  vector  liapunov  functions  and  of  systems  of  pure  difference 
equations . 


RESEARCH  ACCOMPLISHMENTS  AND  CONTINUING  RESEARCH 


1.  Linear  Multivariable  Systems 

a.  Analysis  and  Synthesis  of  Linear  Multivariable  Systems 

Professor  Wolovich  and  Mr.  Panos  Antsaklis,  one  of  his  grad- 
uate students,  have  been  working  on  the  problem  of  arbitrarily  as- 
signing the  closed  loop  poles  of  a linear  multivariable  system 
through  the  employment  of  constant  gain  output  feedback.  This  pro- 
blem, which  is  graphically  resolved  in  the  scalar  case  via  the 
classical  root  locus,  remains  one  of  the  most  important  unresolved 
problems  in  linear  systems  theory.  Nevertheless,  they  have  succeeded 
in  identifying  a real  matrix  ft  whose  rank  represents  a bound  on 
the  maximum  number  of  closed  loop  poles  which  can  be  arbitrarily  as- 
signed via  constant  gain  output  feedback  [2].  Furthermore,  examples 
have  been  obtained  which  illustrate  that  the  bound  cannot  always  be 
attained,  and  further  investigations  are  planned  in  order  to  gain 
additional  insight  with  respect  to  this  question  as  well  as  to  develop 
computational  procedures  for  attaining  "as  much  arbitrary  pole  place- 
ment as  possible". 

As  a result  of  their  investigations,  a new  method  has  been 
found  [3]  for  assigning  min(n,m+p-l)  closed  loop  poles  using  linear 
output  feedback.  Here  n is  the  system  order  and  m and  p the 
number  of  inputs  and  outputs  respectively.  More  specifically,  para- 
metric expressions  of  the  desired  feedback  gain  matrix  H are  de- 
rived which  not  only  allow  the  direct  assignment  of  min(n,m+p-l) 
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closed  loop  poles,  but  also  make  possible  the  "control"  of  the 
remaining  unassignable  poles.  Finally,  as  a consequence  of  the 
above,  an  interesting  generalization  of  a well  known  scalar  result 
is  presented  which  constitutes  a direct  method  of  assigning  min(m,p) 
closed  loop  poles. 

A partial  resolution  of  the  question  of  stability  of  solu- 
tions to  the  minimal  design  problem  has  also  been  obtained  in  terms 
of  transfer  matrix  factorizations  employing  the  new  notions  of 
"common  system  poles"  and  "common  system  zeros"  as  well  as  the  "fixed 
poles"  of  all  solutions  and  those  of  minimal  solutions  [4].  it 
should  be  noted  that  the  minimal  design  problem  is  directly  related 
to  the  question  of  designing  compensators  of  lowest  possible  dynamic 
order  to  achieve  well-defined  closed  loop  performance.  The  results 
obtained  are  employed  to  more  directly  resolve  questions  involving 
the  attainment  of  stable  solutions  to  the  model  matching  problem  as 
well  as  stable  minimal  order  state  observers. 

Finally,  Professor  Wolovich  has  published  a rather  inclusive 
report  [5]  which  outlines  some  of  the  major  recent  contributions  made 
utilizing  the  differential  operator  approach,  rather  than  the  state- 
space  approach,  for  the  analysis  and  synthesis  of  linear  multivariable 
systems.  It  might  be  noted  that  a differential  operator  description 
of  the  dynamical  behavior  of  a physical  system  often  follows  as  a 
direct  result  of  employing  well  known  physical  laws  to  describe  the 
performance  of  the  system,  and  techniques  which  directly  utilize  this 
description  are  often  more  efficient  than  those  which  require  the 
development  and  employment  of  equivalent  state-space  models. 
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b.  Feedback  Sterilization  of  Linear  Systems 

Mew  results  have  been  obtained  in  the  feedback  stabiliza- 
tion of  a linear  time-varying  differential  system  (6]  by  Pearson  and 
Kwon.  The  technique  arises  from  a modified  minimum  energy  regulator 
problem  subject  to  a terminal  constraint  on  the  state.  Minimum  energy 
control  problems  subject  to  a terminal  constraint  on  the  state  have 
been  discussed  in  the  literature  ior  various  missile  control  problems 
and  inevitably  lead  to  a singular  control  law  in  which  the  feedback 
gains  are  unbounded  near  the  terminal  time.  Here  it  is  shown  that 
a certain  modification  of  the  control  law,  which  avoids  the  singular 
property,  leads  to  an  asymptotically  stable  control  system.  Even 
when  specialized  to  the  time  invariant  case,  the  control  law  leads 
to  an  extension  of  some  well-known  methods  for  stabilizing  time  in- 
variant systems  via  the  inverse  of  the  controllability  Gramian  matrix. 
Regarding  the  latter  method  for  stabilizing  discrete  time  systems, 
some  extensions  were  obtained  this  past  year  which  removed  the  assump- 
tion of  nonsingularness  of  the  system  matrix  [7] . 

c.  System  Identification 

Research  in  this  area  by  Pearson  during  the  past  year  has 
resulted  in  two  methods  of  parameter  identification  for  linear  dif- 
ferential systems  which  circumvent  the  need  for  estimating  the  system 
initial  conditions  when  identification  utilizes  only  input-output 
data  observed  over  a finite  time  interval  0 < t < t,  of  arbitrary 
duration.  In  both  methods,  unknown  disturbances  are  modeled  deter- 
ministically by  uncontrollable  modes  and  the  frequencies  present  in 
the  disturbances,  but  not  the  initial  conditions  exciting  such  modes, 


must  be  identified  along  with  the  system  parameters.  In  the  first 
method,  the  disturbances  are  represented  implicitly  and  the  fre- 
quencies associated  with  the  disturbances  must  be  extracted  by  a 
polynomial  factorization  of  the  identified  transfer  function  matrix, 
leaving  a reduced  order  model  which  represents  the  controllable  por- 
tion of  the  system.  A short  paper  describing  this  method  appeared 
in  [8]  and  a full-length  version,  including  computer  simulation  data, 
will  appear  in  [9].  In  the  second  method,  the  disturbances  are 
modeled  explicitly  and  the  identification  procedure  involves  determin- 
ing the  system  and  disturbance  parameters  simultaneously  based  on  in- 
put-cutput  data  on  the  time  interval  0 < t < t^.  Th^  second  method,’ 
which  has  been  reported  in  [10] , is  more  general  than  the  first  in  that 
the  system  parameters  are  allowed  to  enter  nonlinearly  into  the  basic 
model.  The  helicopter  example  in  Section  3 of  [10]  illustrates  the 
importance  of  this  property  in  that  even  though  the  unknown  parameters 
may  enter  linearly  in  the  state  equations,  they  will  nevertheless 
generally  enter  nonlinearly  when  the  input-output  differential  equa- 
tion is  derived.  Disturbance  parameters  always  enter  nonlinearly  with 
the  system  parameters  in  this  method  due  to  the  manner  by  which  they 
are  modeled,  i.e.,  as  uncontrollable  modes.  Computationally,  the 
first  method  involves  solving  linear  algebraic  (normal)  equations  for 
the  unknown  parameters,  followed  by  a polynomial  factorization  routine, 
while  the  second  method  leads  to  scalar  valued  nonlinear  algebraic 
equations.  Computer  simulations  have  not  yet  been  carried  out  for 
the  second  method,  but  are  in  the  planning  stage. 
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d.  Linear  Output  Feedback  Compensation 

In  order  to  represent  the  dynamical  behavior  of  the 
class  of  system  considered,  Falb  and  Wolovich  find  it  convenient 
co  employ  a (general)  differential  operator  representation  [11]  of 
the  form: 

P (D) z (t)  = Q(D)u(t) ; y (t)  - R(D) z (t)  + W(D)u(t),  (1) 

where  z(t)  is  a q-vector  called  the  partial  state,  u(t)  is  an 
m-vector  called  the  input , y(t)  is  a p-vector  called  the  output, 
and  P (D) , Q(D),  R(D)  '.nd  W(D)  are  polynomial  matrices  of  the 
appropriate  dimensions  in  the  differential  operator  D = d/dt  with 
P (D)  q x q and  nonsingular . In  certain  instances,  it  will  be  more 
useful  and  illuminating  to  employ  certain  specialized  forms  of  (1) ; 
i.e.,  either  a controllable  differential  operator  representation 
(til]), 

PR(p)z(t)  = u(t) ; y (t)  = R(D)z(t),  (lc) 

or  an  observable  differential  operator  representation  ([11]), 

Pq  (D)  z (t)  * Q (D) u (t) ; y(t)  = z(t).  (.lo) 

It  should  perhaps  be  noted  that  the  differential  operator  repre- 
sentation represents  an  alternative  to  (actually  a generalization 
of)  a more  conventional  state-space  representation  of  the  form: 

X (t)  = Ax (t)  + Bu (t) ; y (t)  = Cx(t)  + EU(t),  (2) 

where  x(t)  is  an  n-vector  called  the  state  and  A,B,C,  and  E 
are  real  matrices  of  the  appropriate  dimensions.  In  particular, 
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we  note  that  (2)  represents  a special  form  of  (1)  with 
{DI-A,B,C,D}  = {P (D) ,Q  (D) , R (D) ,W(D) }. 

In  view  of  either  representation,  linear  output  feedback  (lof) 
is  defined  by  the  Tontrol  law: 


u ( t ) = -Ey  (t)  + v ( t) 


where  H = [h...]  is  an  m * p real  gain  matrix  and  v(t)  is  an 
m-dimensional  external  input.  It  might  be  noted  that  since  dynamical 
elements  are  not  present  in  (3) , lof  represents  a most  practical 
form  of  compensation  which  is  frequently  employed  in  the  scalar 
(single  input/output)  case.  The  classical  root  locus,  of  course, 
graphically  depicts  the  variation  of  the  poles  of  a scalar  system 
under  lof  compensation  as  a single  gain  varies  over  prescribed 
limits.  The  implementation  simplicity  of  lof  does  not,  however, 
imply  a corresponding  simplicity  of  analysis  in  the  multivariable 
case  as  is  well  known  and  documented,  due  to  the  nonlinearities 
introduced  by  the  cross-coupling  terms.  Nonetheless,  numerous 
investigations  ((12],  (13],  [1#] , [15],  [16])  have  been  undertaken 
in  order  to  provide  new  insight  regarding  this  very  practical  form 
of  feedback  compensation.  The  most  recent  and  illuminating  of 
these  ([13],  [14],  [15])  have  noted  that  it  is  "almost  always" 
possible  to  arbitrarily  assign  min(n,m+p-l)  closed  loop  poles 

via  lof.  Earlier  examples,  however,  have  been  given  which  show 
that  m + p - 1 is  not  generally  an  upper  bound,  and  very  recent 
studies  ([17]  have  established  a new,  more  illuminating  bound  on 
the  maximum  number  of  poles  which  can  be  arbitrarily  assigned  via 
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lof.  The  results  obtained  thus  far,  as  well  as  proposed  extensions, 
will  iibw  be  delineated. 

In  particular,  if  attention  is  restricted  to  the  case  of 
Strictly  proper  systems,  i.e.,  when  E * 0 in  (2)  or,  equivalently* 
when  the  system  transfer  matrix: 

T(sj  « C (sI-A)**^B  - K(b)V~1(b)Q[b)  + W(s)  » R(s)P"Ns)  » P~*  (s)Q(s) , (4) 

as  derived  from  (s) , (1),  (1c) , and  (lo) , respectively#  is  strictly 
proper,  it  follows  that  the  zeros  of 


A„(s)  = j sI-A+BHC|  « 1 Pp  (s / +HR (s ) j **  |Prt.(s)+Q(s)Hj 


represent  the  poles  of  a (state-space  or  differential  operator) 
system  compensated  by  lof.  The  dependency  of  the  zerct  of  AH  (s) 
on  the  (pm)  gain  elements,  h^j,  of  H represents  the  main  focus 
of  this  part  of  the  proposal,  and  a variety  of  questions ‘ related  to 
lof  compensation  are  proposed  for  investigation,  e.g. 


(i)  How  many  zeros  of  A„(s)  can  be  arbitrarily  assigned 


via  H? 


(ii)  Can  a system  be  stabilized  via  lof? 

(iii)  What  is  the  minimum  order  of  a dynamic  compensator 

required  to  insure  complete  and  arbitrary  pole  placement? 

(iv)  What  gain  matrix,  H,  or  set  of  matrices  assigns 
certain  zeros  of  AH(s)? 

It  should  be  noted  that  if,  as  in  most  earlier  investigations, 
one  were  to  employ  a state-space  formulation  in  order  to  study  the 
variation  of  the  zeros  of  |sI-A+BHC|  as  a function  of  the  h^j, 
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then  such  an  investigation  would  involve  the  manipulation  of  more 

parameters  f namely  all  of  the  n (n+m+p)  entries  of  A,B,  and  C, 

than  necessary.  A differential  operator  representation  of  the  form 

(lc)  in  comparison,  completely  describes  the  dynamical  behavior  of 

o 

an  equivalent  system  with  no  more  than  n(m+p)  + m independent 

2 2 

terms,  a computational  savings  of  at  least  n - m terms.  The 
computational  efficiency  associated  with  the  differential  operator 
approach  manifests  itself  in  many  aspects  of  linear  system  analysis 
and  synthesis,  an  observation  which  will  be  more  thoroughly  illus- 
trated in  our  subsequent  discussions. 

Let  us  now  be  specific  regarding  the  progress  made  thus  far 
regarding  our  differential  operator  investigation  of  lof  compensation 
and  proposed  extensions.  To  begin,  V3  note  that  in  view  of  (5), 


Ah(s)  = | [H  X] 


[R(S)  ]\, 

Lpd(s)J 


(e) 


or,  in  view  of  the  Binet-Cauchy  formula  ([18]),  AH(s)  can  be  ex- 
pressed via  the  relation: 


V s)  = l [HI] 

i<j^<j2— • • 


1 2 ...  m 
^1  ^2  *•*  \ 


rR(s) 


LPR(s). 


31  J2 


X 2 • • • rn 


(7) 


where  the  notation  G 


3l  i ' • • • 1 

I . I m 


3l  32 


'm 


denotes  theaappropriate  m order 


minor  of  G.  In  other  words,  in  view  of  (7),  AH(s)  = |Pp(s)+HR(s) | 


R' 


can  be  expressed  as  the  sum  of  g - 


m+pl  _ 

m+p' 

m 

V / 

. P - 

products  of  the 


§ * 
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mth  order  minors  of  [H  I]  and  the  appropriate  m^*1  order  minors  of 
jp^jJ  . This,  in  turn,  implies  that  AH(s)  - A(s),  where 

A(s)  » (PR(s) ( = Jsl-Aj , can  be  expressed  as  the  inner  product 


AH(S)  - ACS)  * MhjMbp  , 


(8) 


where  represents  a g~l  dimensional  row  vector  consisting  of 

individual  and  product  elements  of  the  h. . , and  M_n  represents  a 

lj  RF 


corresponding  column  vector  consisting  of  all  of  the  g mth  order 


minors  of 


"j>  / c\ 

P (s)  except  A(s)  = |PR(s)|:  We  further  observe  that 

_ R 


M^p  can  be  expressed  as  the  product: 


(9) 


for  some  known  real  • (g-l)xn  matrix  ft,,  which  can  be  obtained  from 
either  T(s)  or  (as  shown)  its  factorization,  R(s)P~^(s).  The 

X\ 

polynomials  which  comprise^  M^p  or,  equivalently,  the  matrix 
defined  by  (9)  play  a role  in  linear  system  theory  which  has  yet  to 
be  fully  investigated.  To  indicate  some  progress  which  has  been 


+ 


A portion  of  the  proposed  work  will  address  this  more  general  question. 
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made  regarding  lof,  however,  we  first  define  w as  the  rank  of  ft; 


i.e. 


« - Pin], 


(10)  . 


and  y as  the  minimum  of  w and  mp,  where  mp  represents  the  number 
of  independent  gain  elements,  hi;.,  of  H:  i.e. 


Y = min(w,mp) . 


In  terms  of  these  definitions,  the  following  result  can  be  formally 
established  ([17]).  . 


Theorem  1:  No  more  than  y zeros  of  AH(s)  can  be  arbitrarily 

assigned  via  H, 


m 


It  should  be  noted  that  y represents  a new  and  illuminating 
upper  bound  on  the  (maximum)  number  of  poles  which  can  be  arbitrarily 
assigned  via  lof,  one  which  exceeds  m + p - 1 (see  [13]  and  [14] 
in  particular)  in  a large  number  of  cases..  This  result,  of  course, 
does  not  represent  an  end  in  itself  but  rather  a basis  for  further 
investigations.  In  particular,  the  question  of  whether  or  not  it 
is  possible  to  ’'usually”  assign  y zeros  of  AH(s)  arbitrarily  is 
not  resolved  by  Theorem  1.  Further  investigations  have  revealed  that 

in  certain  cases  it  is  possible  while  in  other  cases  it  is  not.  To 

"1  1 1 , _! 
s s2+1  • f -H  [®  °*1  i 

illustrate,  if  T(s)  = | ’ * 0 | * R(s) p”1 (s) , 

-4  -rr  Li  d is 

s s +1 


1 s 0 s +1 


* R(s)p"1(s)  , 
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then  ft 


0 10  1 
10  10 
0 *.0  1 0 
-0  0 0 X 

•1  0 10 


, a rank  4(=  w)  matrix.  In  this  example. 


n>P  * 4 as  well,  so  that  y * 4.  Although  y * 4,  it  can  be  shown 
that'  it  is  impossible  to  come  "arbitrarily  close"  to  certain  sets  of 
closed  loop  poles;  i.e.,  if  AH(s)  = oQ  + otjS  + ...  + a3s3  + s4  then  • 
the  condition  (ciq+c^)  < ® ^Oo+ala3”°l^  w°uld  necessitate  the  employment 
of  certain  complex  gain  elements  h^.  The  details  associated  with 
this  observation  will  soon  appear  in  J 3.71 . On  the  other  hand. 

Example  8.2.6  in  [11J  represents  another  fourth  order,  two  input,  two 
output  systems  for  which  y * 4 and  complete  and  arbitrary  pole 


placement  via  lof  is  "almost  always"  possible. 

It  thus  follows,  in  view  of  the  above,  that  while  the  condition 
y = n is  necessary,  it  is  not  sufficient  to  insure  complete  and 
arbitrary  pole  placement  for  "almost  all"  sets  of  closed  loop  poles. 
Nevertheless,  the  approach  taken  to  define  ft  and  y is  a novel  one 
which  has  offered,  and  should  continue  to  provide,  significant  new 
insight  regarding  lof  compensation.  It  is  proposed,  therefore,  that 
additional  investigations  be  conducted  with  the  eventual  goal  of 
obtaining  sufficient  conditions  for  "almost  always"  arbitrarily 
assigning  all  n poles  of  a lof  closed  loop  system  when  y « n. 

It  is  felt  that  certain  structural  properties  of  the  matrix  ft  will 
play  an  important  role  in  eventually  resolving  this,  as  well  as  other 
related  questions. 


i 
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With  respect  to  related  questions,  it  has  recently  been 
established  that  when  y < n,  constraint  conditions  on  the  co- 
efficients of  A^Cs)  can  be  obtained  via  (8)  independent  of  the 
h^j . Investigations  are  proposed,  utilizing  these  conditions,  which 
will  resolve  questions  related  to  lof  stabilization  in  such  cases  as 
well  as  those  cases  when  y * n,  but  complete  and  arbitrary  pole 
placement  is  not  possible  (as  in  the  initial  Example) . 

Investigations  are  also  underway  and  proposed  regarding  the 

employment  of  dynamic  compensation  in  combination  with  lof  when 

y < n but  more  design  flexibility  is  desired.  In  particular,  it 

now  appears  that  the  observability  index  associated  with  the  single 

mrp 

input/multiple  output  system  with  transfer  matrix  jjgy  will 
represent  a measure  of  the  minimum  order  of  a dynamic  compensator 
required  for  complete  and  arbitrary  pole  placement,  although  further 
investigations  are  required  to  formalize  this  observation.  To 
summarize,  the  eventual  goal  of  all  of  the  research  conducted  and 
proposed  in  this  section  is  to  develop  practical  low  order  lof 
compensators  for  the  control  of  multivariable  systems. 

2.  Adaptive  Control 

The  formulation  of  the  second  method  for  parameter  identifi- 
cation described  by  Pearson  in  lc.  above  has  also  been  shown  in  Section 
4 of  [10]  to  apply  to  a particular  class  of  parameter  adaptive  control 
problems.  This  class  pertains  to  those  feedback  control  systems  in 
which  the  unknown  plant  parameters,  w,  can  be  dichotomized  into  two 
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sub-vectors,  wft  and  wfa,  i.e.,  w»  (wa#wb) , in  which  the 
vector  wa  has  a relatively  more  important  affect  on  the  stability 
of  the  feedback  system  than  w^.  For  example,  wb  may  contain 
the  parameters  for  external  additive  disturbances,  modeled  a3  un- 
controllable modes,  such  as  wind  gust  effects,  which  do  not  influence 
the  absolute  stability  of  the  feedback  system,  but  would  lead  to 
erroneous  parameter  adaptation  if  ignored  in  the  formulation.  The 
controller  portion  of  the  basic  feedback  control  system  is  assumed 
to  have  been  structured  with  sufficient  flexibility  so  that  there 
exists  an  invertible  function  r between  wa  and  the  controller 

a 

parameters  a,  i.e.,  a = r(w  ),  corresponding  to  which  the 

a 

desired  stability  and  steady  state  error  criteria  are  upheld  uni- 
formly in  wb  when  a * a *=  r( wft) . With  these  basic  assumptions, 
this  class  of  parameter  adaptive  control  problems  is  shown  in  [10] 
to  be  amenable  to  the  same  generic  formulation  as  the  second  method 
for  parameter  identification  discussed  above.  Also,  sufficient 
conditions  for  the  uniqueness  of  solutions  to  the  nonlinear  algebraic 
equations  have  been  obtained  in  [10] . 


3.  Control  of  Bilinear  Systems 

Various  results  relating  to  the  control  of  bilinear  systems 
have  emerged  in  a forthcoming  Ph.D.  dissertation  of  Wei  [19]  under 
the  direction  of  Pearson.  First,  it  is  shown  how  various  nonlinear 
systems  with  trigonometric  nonlinearities  can  be  re-defined  as  a 
bilinear  system  through  a suitable  transformation  of  state  variables. 
Specific  examples  of  such  systems  are  given  in  relation  to  a para- 
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chute  gliding  system  and  a pursuit-evasion  missile  control  system. 

Next,  the  existence  and  uniqueness  of  solutions  to  a class  of  minimum 
energy  control  problems  for  commutative  bilinear  systems  is  shown 
resulting  from  the  discovery  that  the  optimal  control  is  a constant 
vector  determined  by  the  boundary  conditions.  Applications  of  this 
result  are  obtained  for  the  pursuit-evasion  missile  control  .problem 
which  falls  into  the  aforementioned  class  under  the  assumption  that 
the  line  speed  of  the  pursuer  missile  can  be  controlled  in  addition 
to  the  turn  rate.  A suboptimal  control  law  is  obtained  for  this 
class  of  problems  when  higher  order  (actuator)  dynamics  are  included 
in  the  model.  Simulation  studies  for  the  2 dimensional  pursuit- 
evasion  missile  control  problem  have  been  carried  out  which  include 
first  order  actuator  dynamics  and  a least  squares  estimation  al- 
gorithm for  the  target  speed  and  relative  heading,  in  addition  to 
the  control  algorithm  derived  for  the  minimum  energy  interception 
problem. 


4,  Stochastic  Control 

% 

a.  Computational  Methods  for  Control  Problems  with 
Diffusion  Models 

Kushner  completed  a monograph  [20]  on  the  subject,  and  the 
preface,  describing  it  in  more  detail,  follows.  The  monograph  deals 
with  a family  of  interesting  and  useful  techniques  for  approximating 
(for  computational  and  other  purposes)  a large  class  of  optimal 
stochastic  control  problems,  by  simpler  optimal  stochastic  control 
problems.  It  also  develops  a theory  and  technique  for  approximating 
many  types  of  functionals  of  diffusions  that  are  of  interest  all 
through  control  an<*  communication  theory. 


- '~'r> 


.This  book  deals  with  a number  of  problems- concerning  approxi- 
mations, convergence  and  numerical  methods  for  stochastic  control 
problems,  and  also  for  degenerate  elliptic  and  parabolic  equations. 
The  techniques  that  are  developed  seem  to  have  a broader 
applicability  in  stochastic  control  theory.  In  order  to  illustrate 
this,  in  Chapter  11  we  give  a rather  natural  approach  to  the  formula- 
tion and  proof  of  the  separation  theorem  of  stochastic  control 
theory,  which  is  more  general  than,  the  current  approaches  in 
several  respects, 

Tho  ideas  of  the  book  concern  a number  of  interesting 
techniques  for  approximating  (cost  or  performance)  functionals  of 
diffusions  and  optimally  controlled  diffusions,  and  for  approximat- 
ing the  actual  diffusion  process,  defined  by  stochastic  differential 
equations  of  the  It6  type,  both  controlled  and  uncontrolled.  Since 
many  of  the  functionals  that  we  seek  to  compute  or  approximate  are 
actually  weak  solutions  of  the  partial  differential  equations 
(i.e.,  the  weak  solution  can  be  represented,  as  a functional  of  an 
associated  diffusion) , the  techniques  for  approximating  the  weak 
solutions  are  closely  related  to  the  techniques  for  approximating 
the  diffusions  and  their  functionals.  Also,  the  form  of  the  partial 
differential  equation  which  is  (at  least  formally)  satisfied  by  a 
functional  of  interest,  actually  suggests  numerical  methods  for  the 
probabilistic  or  control  problem,. 
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We  develop  numerical  methods  for  optimal  stochastic  control 
theory,  and  prove  the  required  convergence  theorems.  Neither  for 
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this,  nor  for  any  of  the  other  problems,  do  we  require  that  the 
cost  or  optimal  cost  functions  be  smooth,  or  satisfy  any  particular 
partial  differential  equation  in  any  particular- sense.  Nor  do  we 
require,  a-priori,  that  the  optimal  control  exist.  Existence  is  a 
by  product  of  our  method.  The  numerical  techniques  are  intuitively 
reasonable,  admit  of  many  variations  and  extensions,  and  seem  to 
yield  good  numerical  results. 

The  main  mathematical  techniques  are  those  related  to  the 
use  of  results  in  the  theory  of  weak  convergence  of  a sequence  of 
probability  measures.  The  technique  seems  to  provide  a point  of 
view  which  not  only  suggests  numerical  methods,  but  also  unites 
diverse  problems  in  approximation  theory  and  in  stochastic  control 
theory.  The  ideas  of  weak  convergence  theory  are  being  used  more 
and  more  frequently  in  various  areas  of  applications.  But  this 
book,  and  previous  papers  by  the  author  and  some  of  his  students, 
seem  to  be  the  only  currently  available  works  dealing  with 
applications  to  stochastic  control  theory  or  to  numerical  analysis. 
The  proofs  are  purely  probabilistic.  Even  when  dealing  with 
numerical  methods  for  partial  differential  equations,  we  make  no 
explicit  smoothness  assumptions,  and  use  only  probabilistic  methods 
and  assumptions. 

Chapter  X discusses  some  of  the  necessary  probabilistic 
background,  including  such  topics  as  the  Wiener  process,  Markov 
processes,  martingales,  stochastic,  integral s,  Ito’s  Lemma  and 
stochastic  differential  equations.  It  is  assumed,  however,  that 
the  reader  has  some  familiarity  with  the  measure  theoretic 
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foundations  of  probability.  In  Chapter  2,  we  describe  the  basic 
ideas  and  results  in  weak  convergence  theory,  at  least  in  so  far 
as  they  are  needed  in  the  rest  of  the  book^ 

The  computational  methods  of  the  book  are  all  equivalent 
to  methods  for  computing  functionals  of  finite  Markov  chains,  or 
for  computing  optimal  control  policies  for  control  problems  with 
Markov  chain  models.  Many  efficient  computational  techniques  are 
available  for  these  problems.  In  particular,  the  functionals  for 
the  uncontrolled  Markov  chains  are  all  solutions  to  finite  linear 
algebraic  equations.  The  Markov  chain  can  arise  roughly  as 
follows.  We  start  with  the  partial  differential  equation  which, 
at  least,  formally,  is  satisfied  by  a functional  of  the  diffusion, 
and  apply  a particular  finite  difference  approximation  to  it.  If 
the  approximation  is  chosen  carefully  (but  in  a rather  natural 
way) , then  the  finite  difference  equation  is  actually  the  equation 
that  is  satisfied  by  a functional  of  a particular  Markov  chain, 
and  we  can  immediately  get  the  transition  probabilities  for  the 
chain  from  the  coefficients  in  the  finite  difference  equation. 

The  local  properties  of  this  chain  are  very  close  to  the  local 
prope£ti'?s  of  the  diffusion,  in  the  sense  that  there  is  a natural 
time  scaling  with  which  we  interpolate  the  chain  into  a continuous 
parameter  process,  and  the  local  properties  of  the  interpolation 
and  diffusion  are  close  in  certain  important  respects.  Also,  the 
functional  of  the  Markov  chain,  which  is  the  solution  to  the 
approximating  equation,  is  similar  in  form  to  a "Riemann  sum" 
approximation  to  the  original  functional  of  the  diffusion. 

At  this  point,  the  theory  of  weak  convergence  comes  in,  and 
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we  show  that  the  functional  of  the  chain  does  indeed  converge  to 
the  desired  functional  of  the  diffusion,  as  the  difference 
intervals  go  to  zero.  Similarly,  the  approximation  to  the  weak 
sense  solution  to  the  partial  differential  equation  converges  to 
the  weak  sense  solution.  The  interpolation  of  the  chain  also 
converges  (in  a suitable  sense)  to  a solution  to  the  stochastic 
differential  equation.  Of  course,  the  finite  difference  algorithm  . 
is  classical.  But,  neither  the  convergence  proofs  nor  the 
conditions  for  convergence  are  classical.  Also,  the  method  can 
handle  a much  broader  class  of  functionals  than  those  that  may 
possibly  solve  some  partial  differential  equation.  • 

It  is  not  necessary  that  we  use  finite  difference  methods; 
their  use  does,  however,  yield  an  .automatic  way  of  generating  a 
family  of  approximating  chains,  whether  or  not  the  functional  is 
smooth.  However,  many  types  of  approximations  are  usable, 
provided  only  that  they  yield  the  correct  limiting  properties  . 
Indeed,  this  versatility  is  one  of  the  strong  points  of  the 
approach. 

Approximating  with  Markov  chains  (whether  or  not  we  use 
classical  finite  difference  techniques)  allows  us  to  use  our 
physical  intuition  - to  guide  us  in  the  choice  of  a chain,  or  in 
the  selection  of  a computational  procedure  for  solving  the 
equation  for  the  functional  of  the  chain.  Our  sense  of  the 
"dynamics"  of  the  process  plays  a useful  role  and  can  assist 
us  in  the  selection  of  procedures  which  converge  faster. 

In  the  case  of  the  optimal  control  problem,  we  start  by 
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approximating  the  non-linear  (Bellman)  partial  differential 
equation,  which  is  formlly  satisfied  by  the  minimal  cost  function. 
With  a suitable  choice  of  the  approximation,  the  discrete  equations 
are  just  the  dynamic  programming  equations  for  the  minimal  cost 
function  for  the  optimal  control  of  a certain  Markov  chain. 

Again,  there  are  many  types  of  useful  approximating  chains.  This 
non-linear  partial  differential  equation,  or  optimal  control, 
case  is  much  more  difficult  than  the  uncontrolled  or  linear  partial 
differential  equation  case.  However,  the  ideas  of  weak  convergence 
theory,  again,  play  a very  useful  role.  Under  broad  conditions, 
we  can  show  that  the  sequence  of  optimal  costs  for  the  con  trowed 
chain  converge  to  the  optimal  cost  for  the  controlled  diffusion. 
Indeed,  it  can  even  be  shown  that  the  (suitably  interpolated) 
chians  converge,  in  a particular  sense,  to  an  optimally  controlled 
diffusion. 

In  Chapter  3,  we  give  the  required  background  concerning  # 
the  equations  satisfied  by  various  functionals  of  Markov  chains, 
both  controlled  and  uncontrolled.  Our  method  is  able  to  treat 
optimal  control  problems  with  various  types  of  state  space 
constraints.  However,  this  often  requires  a linear  programming 
(rather  than  a dynamic  programming)  formulation,  and  this  is  ilso 
discussed  in  Chapter  3. 

Chapter  4 discusses  the  relations  between  diffusion  processes 
and  elliptic  and  parabolic  partial  differential  equations,  both 
non-degenerate  and  degenerate  and  linear  and  non  linear.  Proofs  are 
not  given.  The  representation  of  the  solutions  of  the  linear 
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equations  in  terms  of  path  functionals  of  the  diffusion  is  discussed, 
as  well  as  the  relation  between  certain  non-linear  equations  and 
optimal  stochastic  control  problems.  Chapter  5 is  an  introduction 
to  the  techniques  and  results  of  the  sequel.  In  order  to  illustrate 
some  of  the  simpler  ideas,  the  techniques  of  weak  convergence  theory 
are  apDiied  to  a simple  two  point  boundary  value  problem  for  a 
second  order  differential  equation. 

In  Chapter  6,  we  begin  the  systematic  exploitation  and 
development  of  the  ideas.  The  motivation  for  the  types  of  approxi- 
mations is  given,  and  the  approximation  of  a variety  of  functionals 
of  uncontrolled  diffusion  and  linear  elliptic  equations  is  treated. 

We  also  show  how  to  approximate  an  invariant  measure  of  the 
diffusion,  by  an  invariant  measure  of  an  approximating  chain,  and 
discuss  the  use  of  the  approximations  for  Monte-Carlo,  and  give 
some  numerical  data.  The  approximations  that  are  explicitly 
discussed  are  derived  by  starting  with  finite  difference  techniques  ; 
all  of  them  yield  Markov  chain  approximations  to  the  diffusion. 
However,  it  should  be  clear,  from  the  development,  that  many  other 
methods  of  approximation  can  be  handled  by  the  same  basic  techniques. 
The  general  approach  taken  here  should  motivate  and  suggest  other 
methods  with  perhaps  preferable  properties  for  specific  problems. 

Chapter  7 deals  with  the  parabolic  equation,  and  with  the 
probabilistic  approach  to  approximation  and  convergence  for  explicit 
and  implicit  (and  combined)  methods.  Furthermore,  approximations 
to  a (currently  much  studied)  class  of  non-linear  filtering  problems 
are  discussed.  Some  numerical  data,  concerning  approximations  to 
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an  invariant  measure,  is  given. 

In  Chapter  8,  we  begin  the  study  of  non-linear  parv.ial 
differential  equations  and  approximations  to  optimal  control 
problems,  in  particular  to  the  optimal  stopping  and  impulsive 
control  problems.  The  discretizations  of  the  optimization  problems 
for  the  diffusion  yield  similar  optimization  problems  on  the 
approximating  Markov  chains.  We  are  able  to  prove  that  the 
approximations  to  the  optimal  processes  and  cost  functions 
actually  converge  to  the.  optimal  processes  and  cost  functions, 
resp.  The  study  of  non-linear  partial  differential  equations 
and  optimal  control  problems  continues  in  Chapter  9,  where  a 

4 

variety  of  approximations  and  control  problems  are  discussed. 

In  order  to  show  that  the  limiting  cost  functionals  are  truly 
minimal  (over  some  specified  class  of  control  policies) , and  that 
the  limiting  processes  have  the  probabilisitc  properties  of  the 
optimally  controlled  diffusion,  a number  of  techniques  are 
developed  for  approximating  arbitrary  controls,  and  for  proving 
admissibility  or  existence.  It  is  expected  that  many  aspects  of 
the  general  approach  will  be  quite  useful  in  other  areas  of 
stochastic  control  theory.  Additional  numerical  data  appears  in 
Chapters  8 and  9.  Again,  it  must  be  emphasized  that  much  more  work 
needs  to  bo  done  - to  investigate  various  types  of  approximations 
- in  order  to  fully  understand  which  types  of  approximations  are 

preferable,  and  why. 

In  Chapter  10,  we  treat  two  types  of  extensions  of  the  ideas  in 
Chapters  6 and  7.  First,  approximations  to  stochastic  differential 
difference  equations,  and  to  path  functionals  of 
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such  processes,  are  developed.  Then,  we  discuss  the  problem  of 
diffusions  which  are  reflected  from  a boundary,  and  the  corres- 
ponding partial  differential  equations  with  mixed  Neumann  and 
Dirichlet  boundary  conditions. 

Hopefully,  the  book  will  help  open  the  door  wider  to  an 
interesting  direction  of  research  in  stochastic  control  theory. 
Similar  techniques  can  be  applied  to  the  problem  where  the  stochas- 
tic differential  equation  has  a 'jump  term",  and  the  partial  dif- 
ferential equations  are  replaced  by  partial  differential  integral 
equations . 


b.  Sequential  Monte  Carlo  Methods  for  Optimizing  Con- 
strained Noisy  Control  Systems 

Kushner  has  continued  his  investigations  [21,22]  into 
the  above  subject,  which  has  numerous  applications  in  sys terns  op- 
timization. The  subject  is  the  Monte  Carlo  version  of  nonlinear 
programming.  The  results  this  year  were  of  two  types.  First,  a 
rather  extensive  series  of  computer  investigations  is  underway  - 
concerning  the  numerical  properties  of  algorithms  that  were  theo- 
retically analyzed  last  year.  Algorithms  were  of  several  types, 

for  equality  constraints  only,  Lagrangian  methods  for  inequality 
penalty  - Lagrangian  methods  for  inequality  constraints, 
constraints, /and  several  types  of  'pseudo  projection*  methods.  The 

purpose  of  the  investigation  is  to  gain  a thorough  understanding 

of  the  advantages,  shortcomings,  numerical  properties,  etc.,  of  the 

algorithms  - to  enable  us  to  improve  and  develop  them.  The  results, 

sc  far,  have  been  extremely  good;  it  appears  that  the  algorithms 
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are  both  interesting  and  useful,  and  we  are  well  on  the  way  .to 
understanding  their  numerical  properties. 

The  second  type  of  effort  concerned  the  theoretical  proper- 
ties of  the  algorithms  themselves.  Typically,  various  restrictive 
conditions  were  put  on  the  coefficient  sequences  (such  as  square 
summability) , and  the  observation  noises  were  assumed  to  be  un- 
correlated. Using  some  rather  powerful  ideas  in  the  theory  of 
weak  convergence  of  measures,  Kushner  has  proved  the  convergence 
theorems  under  substantially  weaker  and  more  practical  conditions. 

c.  Generalized  Solutions  in  Optimal  Stochastic  Control 

In  a paper  on  generalized  solutions  in  optimal  stochastic 
control  [23],  Fleming  discusses  two  kinds  of  such  solutions.  The 
first  kind  is  introduced  to  deal  with  lack  of  a Filippov-type  con- 
vexity condition,  much  as  in  ordinary  (deterministic)  optimal  control 
theory.  Results  about  the  existence  of  an  optimum  are  obtained  for 
stochastic  problems  in  which  the  data-fields  available  to  the  con- 
troller do  not  vary  with  the  control  chosen.  In  particular,  these 
results  apply  to  open  loop  problems  and  to  problems  with  completely 
observed  system  states.  For  the  latter  class  of  problems,  it  is 
noted  that  the  method  of  dynamic  programming  frequently  gives  an 
ordinary  (non-generalized)  feedback  station  without  assuming  any 
convexity  conditions. 

A difficult  open  question  is  the  question  of  existence  of 
optimal  controls  for  stochastic  problems  with  partially  observed 
system  states.  A second  kind  of  generalized  solution  is  introduced 
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as  a step  toward  dealing  with  this  matter.  Following  Benes,  Davis- 
Varaiya,  and  Bismut,  the  problem  is  reformulated  as  one  of  finding 
a Gersanov  density  whose  integral  with  respect  to  Wiener  measure 
on  the  space  ft  of  possible  system  trajectories  is  optimized.  In 
case  of  partially  observed  states,  the  set  A of  densities  corres- 
ponding to  ordinary  controls  is  neither  weakly  closed  nor  convex, 

2 

in  the  space  L (ft)  of  square  integrable  densities.  Generalized 
controls  correspond  to  points  of  the  weak  closure  B of  the  convex 
hull  of  A.  A partial  characterization  of  points  of  B is  obtained 
in  terms  of  auxi.'  liary  randomizations . 

5.  Bifurcation  Theory 

Hale  has  continued  his  work  on  nonlinear  oscillations  and  bi- 
furcation theory.  Chow,  Hale  and  Mallet-Paret  [24,  25]  have  given 
a general  theory  of  bifurcation  for  families  of  mappings  which 
depend  on  two  parameters  X , |i . The  complete  bifurcation  picture  is 
obtained  for  X,y  varying  independently  in  a neighborhood  of  some 
point.  Applications  have  been  given  to  the  von  Karmdn  equations 
for  a rectangular  plate  and  thin  shells  with  lateral  loading  and 
normal  loading. 

In  his  thesis  directed  by  Hale,  List  [26]  considers  the 
above  parameters  as  well  as  an  additional  one  concerned  with  the 
shape  of  the  plate.  Other  applications  are  contained  in  Hale  [27, 
28]. 

Hale  and  Rodrigues  [29]  have  been  discussing  the  classical 
forced  Duffing  equation  with  and  without  damping  and  have  been 
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attempting  to  characterize  the  behavior  of  the  periodic  solutions 
as  a function  of  the  parameters  and  allowing  the  parameters  to 
vary  independently.  Surprisingly,  no  one  has  given  the  bifurcation 
diagram  for  this  simple  equation.  The  discussion  requires  an  ex- 
tension of  the  methods  previously  mentioned  above. 

6.  Control  of  Systems  Governed  by  Ordinary  and  Functional 
Differential  Equations 

a.  Functional  Differential  Equations:  Stability  and 

Periodic  Solutions 

Hale  has  continued  to  develop  the  general  theory  of  func- 
tional differential  equations  both  of  retarded  and  neutral  type:. 

In  the  area  of  stability,  he  has  given  a rather  complete  descrip- 
tion of  the  behavior  near  a constant  solution  [30].  This  theory 
gives  a description  of  the  center  manifold  theorem  as  well  as  prac- 
tical methods  of  determining  stability  in  critical  cases.  The 
Hopf  bifurcation  theorem  for  ordinary  differential  equations  can 
also  be  generalized  by  using  these  results.  In  the  development  of 
this  theory,  a special  transformation  was  devised  which  permits  one 
to  obtain  a vector  field  on  the  center  manifold.  This  transformation 
has  proved  to  be  very  useful  in  the  study  of  combined  sets  of  dif- 
ferential-difference and  difference  equation  which  occur  often  in 
the  theory  of  gas  dynamics  and  transmission  lines  (see  [31]). 

For  equations  of  neutral  type,  some  very  interesting  and 
important  problems  on  the  stability  of  difference  equations  have 
arisen.  For  example,  consider  the  difference  equation, 
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N 

x(t)  * l A.x(t-r.), 
k»l  K K 

where  each  > 0 and  each  is  an  n x n matrix.  If  this 

equation  is  stable  for  one  set  of  values  (r^,...,rN),  is  it  also 
stable  for  values  close  to  these?  The  answer  in  general  is  no. 

Hale  [32]  has  shown  that  if  stability  is  preserved,  then  the 
equation  must  be  stable  for  all  values  of  (r^,...^).  In  his 
thesis  supervised  by  Hale,  Silkowskii  [33]  has  given  necessary  and 
sufficient  conditions  for  this  type  of  stability  to  hold. 

Silkowskii  [33]  has  also  given  a method  easier  to  apply 
than  Pontryagin  for  obtaining  the  stability  of  solutions  of  linear 
differential-difference  equations  with  constant  coefficients.  Tsen, 
under  the  direction  of  Infante,  is  continuing  to  work  on  these  im- 
portant stability  questions. 

Many  theoretical  results  on  fixed  points  of  mappings  have 
arisen  because  of  the  discussion  of  the  existence  of  periodic  orbits 
of  periodic  dissipative  systems  (see,  for  example,  Hale  and  Lopes 
[34],  Chow  and  Hale  [35],  Hale  [36]).  These  results  were  applied 
by  Lopes  [37]  to  equations  of  neutral  type.  The  results  also  have 
implications  on  uniformly  ultimate  boundedness  and  the  basic  definitions 
of  stability  (see  the  forthcoming  book  of  Hale  [38]). 
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b.  Optimal  Control  of  Systems  with  Delays:  Approximation 

Techniques  for  Linear,  Bilinear,  and  Weakly  Nonlinear  Systems 
Banks  has  continued  his  investigation  of  approximation 
methods  for  optimal  control  problems  governed  by  autonomous  functional 
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differential  equations.  During  the  past  year,  he  has  completed 
a rather  extensive  study  for  linear  systems  of  both  theoretical 
and  numerical  aspects  of  a method  based  on  use  of  "averaging" 
approximations  formulated  in  the  context  of  a framework  that  is 
a modification  of  the  one  detailed  in  [39].  The  numerical  results 
(which  substantiate  theoretical  findings  that  this  method  is  indeed 
a good  one  for  a large  class  of  linear  system  problems)  are  re- 
ported in  [40] . In  that  report  a generous  supply  of  examples  (in- 
cluding some  involving  systems  such  as  those  modeling  a harmonic 
oscillator  with  delayed  damping  or  delayed  restoring  force)  were 
solved  both  analytically  (using  the  necessary  and  sufficient  condi- 
tions for  optimal  control  of  delay  systems  - developed  previously 
by  Banks  among  others),  and  numerically  (via  the  "averaging" 
approximation  techniques)  and  the  solutions  compared. 

A modification  (which  allows  the  treatment  of  a larger  class 
of  approximation  techniques  within  tie  context  of  the  framework)  of 
the  conceptual  framework  in  [39]  along  with  new  theoretical  results 
for  the  "averaging"  approximation  methods  were  developed  in  [41]  for 
optimal  control  problems  with  (n-vector)  system  equations 

v r0 

x(t)  = l A.x(t-h.)  + D(s)x(t+s)ds  + Bu (t) , t e [0,t, J (1) 
i=Q  1 1 J-r 

where  0 a h < h^  < ...  < hv  < r.  Briefly,  this  approximation 
technique  involves  solving  a sequence  of  control  problems  governed 
by  the  vector  ordinary  differential  equations  (which  are  approxima- 
tions to  (1) ) 


wN(t)  = ANwN(t)  + col(Bu(t)  ,0, ... ,0) 


where  wN  is  a vector  in  aN  is  the  n (N+l)  square 

matrix  (taking  v = 1 in  (1) ) 
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In  [41]  there  is  also  given  a thorough  discussion  of  the  relation 
of  our  results  to  a number  of  heuristic  (and,  in  some  cases,  in- 
correct) uses  of  similar  higher-order  ODE  approximation  ideas  for 
FDE  found  in  the  engineering  literature  during  the  past  8-10  years. 

Our  analysis  has  yielded  precise  convergence  results  along  with 
error  estimates  (see  [42]).  In  addition,  Banks  has  recently  succeeded 
in  extending  some  of  these  approximation  ideas  to  treat  certain  pro- 
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blems  with  nonlinear  systems  of  the  form: 


x (t)  * L(xt)  + f (x(t)  ,xfc,u(t)) , t e [0,t^] . (2) 

Here  L is  the  same  linear  operator  (on  xfc,  where  xfc  (0)  = 
x(t+0),  -r  < 0 £ 0)  as  given  in  the  right  side  of  (1)  above.  Ex- 
amples of  systems  which  are  included  in  the  extended  theory  for  (2) 
are  bilinear  control  problems  of  a somewhat  standard  type  arising 
in  applications  and  nonlinear  systems  of  the  type  currently  under 
investigation  in  models  for  protein  synthesis.  Details  of  these 
results  along  with  a discussion  of  these  models  can  be  found  in  [42]. 
Work  on  extensions  of  these  ideas  to  other  nonlinear  problems  is 
continuing. 


c.  Vector  Liapunov  Functions  and  Stability  Theory  of 
Ordinary  Differential  Equations 

Following  ideas  that  first  appeared  in  [43]  and  [44], 
LaSalle  corrected  a result  in  [43]  in  formalizing  an  idea  due  to 
the  economist  Arrow  for  the  construction  of  a Liapunov  function 
from  a number  of  scalar  functions,  none  of  which  need  be  a Liapunov 
function.  Arrow  did  not  express  his  idea  in  these  terms.  This  can 
be  viewed  as  a vector  Liapunov.  LaSalle  has  further  studied  the 
idea  of  vector  Liapunov  functions  and  used  them  to  investigate  and 
obtain  new  results  on  global  asymptotic  stability  (see  [45]).  This 
more  general  ide  . of  a vector  Liapunov  function,  which  arose  quite 
naturally  in  economics,  should  be  useful  in  deriving  certain  types 
of  control  laws.  This  has  not  yet  been  explored. 
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The  deeper  knowledge  that  we  now  have  of  the  invariance 
properties  of  the  limit  sets  of  the  solutions  of  ordinary  differen- 
tial and  difference  equations  in  the  nonautonomous  case  increases 
in  importance  a type  of  theorem  due  originally  to  Yoshizawa  and 
later  modified  by  LaSalle.  The  theorem  has  to  do  with  the  set  E 
associated  with  a Liapunov  function.  The  application  of  the  newer 
invariance  results  requires  a further  improvement  in  Yoshizawa' s 
result.  By  extending  the  concept  of  a Liapunov  function  for  non- 
autonomous systems,  LaSalle  has  given  a newer  version  of  Yoshizawa' s 
theorem.  The  conditions  imposed  are  weaker  than  those  of  Artstein 
and  also  include  a recent  result  given  by  Onuchic  al  in  [46]. 

These  results  of  LaSalle  and  some  new  sufficient  conditions  for 
asymptotic  stability  and  instability  can  be  found  in  [47]  and  [48]. 

From  time  to  time  during  the  past  5 years  LaSalle  has  thought 
a great  deal  about  the  problem  of  the  stability  of  feedback  struc- 
tures for  the  implementation  of  optimal  control  without  much  success. 
It  is  clear  that  in  the  absence  of  perturbations  there  can  be  an 
infinity  of  feedback  structures,  all  of  which  give  the  same  optimal 
performance.  Which  of  these  is  in  some  sense  the  "best"  or,  at  least, 
possess  some  stability  under  perturbations?  This  is  the  practical 
problem  engineer's  solve  in  building  real  systems.  It  should  be 
possible  to  develop  a general  theory  and  to  discover  some  general 
principles.  We  have  in  the  past  proposed  studying  this  problem. 
LaSalle  has  done  so  but,  as  was  said  above,  without  success.  The 
few  simple  examples  where  the  problem  can  be  solved  are  too  trivial 
to  be  helpful  in  finding  a suitable  mathematical  formulation  of  the 
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general  problem.  They  do#  however,  show  that,  even  for  ordinary 
differential  equations,  the  available  feedback  structures  (those 
that  are  physically  realizable)  immediately  take  one  beyond  ordinary 
differential  equations,  and  this  is  the  difficulty.  One  idea  here 
is  to  study  the  problem  for  discrete  systems  but  this  would  seem  to 
require  first  a further  development  of  the  theory  of  discrete  pro- 
cesses. 


d.  Difference  Equations 

Important  mathematical  models  are  derived  from  the  ob- 
servation at  discrete  times  of  continuous  processes.  Most  of  the 
data  in  many  real  problems  of  process  control  is  available  only  at 
discrete  times.  LaSalle  has  noted  that,  taking  a general  point  of 
view  of  a continuous  process  (general  enough  to  include  all  the 
usual  mathematical  models  — ordinary  and  functional  differential 
equations,  etc.)  the  observed  discrete  process  is  equivalent  to  a 
system  of  difference  equations  on  the  state  space,  which  may  or  may 
not  be  finite  dimensional.  The* discrete  observation  of  processes 
generated  by  ordinary  differential  equations  yield  what  engineers 
call  "sampled  data  systems".  Difference  equations,  even  in  the 
finite  dimensional  case,  reflect  aspects  of  reality  not  covered  oy 
ordinary  differential  equations.  Not  every  finite  dimensional  system 
of  difference  equations  can  be  generated  by  the  discrete  observation 
of  a system  of  ordinary  differential  equations.  That  this  is  so  is 
easily  seen  from  the  fact  that  there  is  in  existence  and  uniqueness 
of  solutions  of  difference  equations  only  in  the  forward  direction 
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of  time  — two  different  past  histories  can  lead  to  the  same  state 
but  from  then  on  the  solution  is  unique.  This  is  expected  when- 
ever there  are  delayed  effects  in  the  dynamics  of  the  system. 

Much  of  what  we  have  learned  recently  about  differential 
equations  and  dynamical  systems  has  not  been  applied  to  the  study 
of  these  simple,  but  practically  important,  discrete  models.  For 
this  reason  LaSalle  began  last  summer  a study  of  discrete  processes 
and  has  obtained  a number  of  new  results  in  the  theory  of  difference 
equations.  For  example,  LaSalle  has  done  for  nonautonomous  difference 
equations  what  Artstein  (see  the  Appendix  by  Artstein  in  [49]  did 
for  nonautonomous  ordinary  differential  equations  in  the  study  of 
limiting  equations  and  invariance  properties.  This  has  enabled  him 
to  extend  the  earlier  work  of  Hurt  in  [50]  in  applying  the  invariance 
principle  to  extend  Liapunov’s  direct  method.  An  exposition  of  some 
of  these  results  can  be  found  in  [49]  and  [51],  LaSalle  is  writing, 
and  has  partially  completed,  a book  giving  a modern  treatment  of  the 
theory  of  difference  equations  (discrete  processes)  with  emphasis  on 
their  stability. 


57> "^TP?S? * .^TV'.'r.-'-f/  :v  “v 


- -y  :r  „ 


III-l 


SECTION  III 


REFERENCED  PAPERS 


[1]  Fleming,  W.  H.  and  Rishel,  R.  W. , Deterministic  and  Stochastic 
Optimal  Control,  Springer-Verlag,  1975. 

[2^  Wolovich,  W.  A.  and  Antsaklis,  P.  J. , Some  new  bounds  related 
to  output  feedback  pole  placement,  to  appear  IEEE  Trans.  Auto. 
Control . 

[3]  Antsaklis,  P.  J.  and  Wolovich,  W.  A.,  Arbitrary  pole  placement 
using  linear  output  feedback  compensation,  to  appear  Intn’l 
Journal  on  Control. 

£4]  Wolovich,  W.  A.,  Antsaklis,  P.  and  Elliott,  H. , On  the  stability 
of  solutions  to  minimal  and  nonminimal  design  problems,  sub- 
mitted for  publication  - IEEE  Trans.  Auto.  Control,  Feb.,  1976. 

[5]  Wolovich,  W.  A. , The  differential  operator  approach  to  linear 
system  analysis  and  design.  Journal  of  the  Franklin  Institute, 

Vol . 301  Nos.  1 and  2,  January  - February,  1976,  pp.  27-47. 

[6]  Kwon,  W.  H.  and  Pearson,  A.  E.,  A modified  minimum  energy 
regulator  problem  and  feedback  stabilization  of  a linear  system, 
Proc.  of  1976  Conf.  on  Inform.  Sci.  and  Syst.,  Johns  Hopkins 
Univ.,  April  1976. 

[7]  Kwon,  W.  H.  and  Pearson,  A.  E.,  On  the  stabilization  of  a dis- 
crete constant  linear  system,  IEEE  Trans,  on  Auto.  Con-rol, 

Vol.  AC-20,  pp.  800-801,  Dec.  l';75. 

[8]  Pearson,  A.  E.,  Identification  of  linear  differential  systems 
from  input-output  data  without  estimating  the  initial  state, 

Proc.  of  1975  Conf.  on  Inform.  Sci.  and  Syst.,  pp.  387-390, 

Johns  Hopkins  Univ.,  April  1875. 

[9]  Pearson,  A.  E.,  Finite  time  interval  linear  system  identification 
without  initial  state  estimation,  to  appear  ir.  Autonuitica,  Nov.  1976. 

[10]  Pearson,  A.  E.,  Positive  definite  performance  functions  for 
parameter  adaptive  control  problems,  Proc.  of  1975  IEEE  Conf. 
on  Decis.  and  Contr.,  pp.  844-849,  Houston,  Texas,  Dec.  1975 


III-2 


Referenced  papers  - continued 


[11]  Wolovich,  W.  A. , Linear  Multivariable  Systems,  Springer- 
Verlag.  New  York.,  1974. 

[12]  Sridhar,  B.  and  Lindorff,  D.P.,  Pole  placement  wich  constant 
gain  output  feedback,  Int.  J.  Control,  1£,  1973. 

[13]  Kimura,  H.,  Pole  assignment  by  gain  output  feedback,  IEEE 
AC-20,  1975. 

[14]  Davison,  E.  J.  and  Wang,  S.  H.,  On  pole  assignment  in  linear 
multivariable  systems  using  output  feedback,  IEEE  AC-20,  1975. 

[15]  Power,  H.  M. , A new  result  on  eigenvalue  assignment  by  means 
of  dyadic  output  feedback,  Int.  J.  Control,  21,  1975. 

[16]  Wolovich,  W.  A.  and  Antsaklis,  P.  J.,  Output  feedback  compen- 
sation in  multivariable  systems,  IEEE  Conf.  on  Decision  and 
Control,  Phoenix,  1974. 

[17]  Antsaklis,  P.  J.  and  Wolovich,  W.  A.,  On  the  compensation  of 
multivariable  systems  by  output  feedback,  to  appear. 

[18]  Gantmacher,  P.  R. , Theory  of  Matrices,  Chelsea,  New  York,  1959. 

[19]  Wei,  K.  C.,  Optimal  control  of  bilinear  systems  with  some 
aerospace  applications,  Ph.D.  Dissertation,  Brown  Univ. , 

June  1976. 

[20]  Kushner,  Harold  J.,  Probability  Methods  for  Approximations 
in  Stochastic  Control  and  for  Elliptic  Equations,  Academic 
Press,  Inc.,  to  appear. 

[21]  Kushner,  Harold  J.,  Rates  of  convergence  for  sequential  Monte 
Carlo  Optimization  methods,  to  appear. 

[22]  Kushner,  Harold  J.,  Asymptotic  error  rates  for  sequential 
Monte  Carlo  optimization  methods,  to  appear. 

[23]  Decker,  Marcel  and  Fleming,  W.  H. , Generalized  solutions  in 
optimal  stochastic  control,  Proceedings  Second  Kingston  Con- 
ference on  Differential  Games  and  Control  Theory,  June  1976, 
to  appear. 

[24]  Hale,  Jack  K.  (with  S-N.  Chow  and  J.  Mallet-Paret) , Applica- 
tions of  Generic  Bifurcation,  I,  Archives  Rational  Mechanics 
< ■■  s Analysis,  Vol.  59,  No.  2,  T1974)  , pp.  159-188. 


Referenced  papers  - continued 


[25]  Hale,  Jack  K.  (with  S-N  Chow  and  J.  Mallet-Paret) , applica- 
tions of  Generic  Bifurcation,  II,  Archives  for  Rational 
Mechanics  and  Analysis,  to  appear. 

[26]  List,  Stephen,  Generic  bifurcation  with  application  to  the 
von  Karman  Equations,  Ph.D.  Thesis,  Brown  Univ.  6(1976). 

[27]  Hale,  Jack  K.,  Bifurcation  with  several  parameters.  Invited 
lecture  - VII  Int.  Conf.  or.  Nonlinear  Oscillations,  Humboldt 
Univ.,  West  Germany,  y/8-13/1875. 

[28]  Hale,  Jack  K.,  Restricted  generic  bifurcation,  presented 
at  Dynamical  Systems  Conf. , Univ.  of  Florida,  Gainesville, 
Florida,  3/23-26/76. 

[29]  Hale,  Jack  K.  (with  ri.  M.  Rodriques),  Bifurcation  in  the 
Duffing  equation  with  independent  parameters,  submitted: 

Proc.  Royal  Society  Edinburg  - Series  A.  5(1976). 

[30]  Hale,  Jack  K.,  Behavior  near  constant  solutions  of  functional 
differential  equations,  Jour.  Dif.  Eqns.,  Vol.  15,  No.  2, 
3(1974),  pp.  278-294. 

[31]  Hale,  Jack  K.  (with  Pedro  Marti nez-Amores) , Stability  in 
Neutral  Equations,  Jour.  Nonlinear  Anal.:  Theory,  Methods 
& App.  to  appear. 

[32]  Hale,  Jack  K.,  Parametric  stability  in  difference  equations, 
Bollettino  U.M.I.  (4)  II,  Suppl  fasc.  3(1975),  pp.  209-214. 

[33]  Silkowski,  R.  A.,  Star-shaptd  regions  of  stability  in  heredi- 
tary systems,  Ph.D.  Thesis,  Brown  Univ.  6(1976). 

[34]  Hale,  Jack  K.  and  0.  Lopes,  Fixed  point  theorems  and  dissipa- 
tive processes,  Jour.  Dif.  Eqns.,  Vol.  13,  No.  2,  5(1973), 
pp.  391-402. 

[35]  Hale,  Jack  K.  (with  Shui *Nee  Chow),  Strongly  limit-compact 

maps,  Funkcialaj  Ekvacioj , 17(1974),  pp.  31-38 

[36]  Hale,  Jack  K. , Continuous  dependence  of  fixed  points  of 
condensing  maps,  JMAA,  Vol.  46,  No.  1,  4(1974),  pp.  1-7. 

[37]  Lopes,  0.  F. , Asymptotic  fixed  point  theorems  and  forced  os- 
cillations in  neutral  equations,  Ph.D.  Thesis,  Brown  Univ. 

6 (1973)  . 


Ill— 4 


Referenced  papers  - continued 


[38]  Hale,  Jack  K.,  Theory  of  Functional  Differential  Equations, 
Springer-Verlag,  to  appear* 

[39]  Banks,  H.  T.  and  Burns,  J.  A.,  An  abstract  framework  for 
approximate  solutions  to  optimal  control  problems  governed 

by  hereditary  systems,  in  Int.  Conf,  on  Differential  Equations 
(H.  Antosiewicz,  ed.)  Academic  Press,  1075,  pp.  10-25. 

[40]  Banks,  H.  T. , Burns,  J.A.,  Cliff,  E.  M.  and  Thrift,  P.R. , 
Numerical  solutions  of  hereditary  control  problems  via  an 
approximation  technique,  LCDS  Tech.  Rep.  75-6,  October  1975, 
Brown  Univ. 

[41]  Banks,  H.  T.  and  turns,  J.  A.,  Hereditary  control  problems: 
numerical  methods  based  on  averaging  approximations,  Jan.  1976, 
submitted  to  SIAM  J.  Control  and  Optimization. 

[42]  Eanks,  H.  T. , Approximation  methods  for  optimal  control  pro- 
blems with  delay-differential  systems.  Seminaires  IRIA  analyse 
et  controle  de  systemes,  Rocquencourt , 1976  (to  appear) . 

[43]  Onwuchekwa,  E.  N.,  Stability  of  differential  equations  with 

applications  to  economics.  Ph.D.  dissertation,  Brown  Univ., 
6(1975).  ' 

[44]  LaSalle,  J.  P.  and  Onwuchekwa,  E.  N.,  An  invariance  principle 
for  vector  Liapunov  functions.  Dynamical  Systems:  An  Interna- 
tional Symposium,  Vol.  II,  Academic  Press,  New  York,  1976, 

pp.  291-295. 

[45]  LaSalle,  J.  P.,  Vector  Liapunov  functions.,  Bull.  Instit. , 
Academia  Sinica,  Taiwan,  3(1975),  pp.  139-150. 

[46]  Onuchic,  N.,  Onuchic,  R.  and  Taboas,  P.,  Invariance  properties 
in  the  theory  of  stability  for  ordinary  differential  systems 
and  applications.  J.  Applicable  Analysis  5(1975),  pp.  101-107. 

[47]  LaSalle,  J.  P.,  Stability  of  nonautonomous  systems.  J.  of 
Nonlinear  Analysis:  Theory,  Methods  & App.,  to  appear. 

[48]  LaSalle,  J.  P.,  New  stability  results  for  nonautonomous  systems, 
presented  at  Dynamical  Systems  Conf.  - Gainesville,  Florida 
3/24-1-26/76,  to  appear. 

[49]  LaSalle,  J.  P.,  The  Stability  of  Dynamical  Systems,  Regional 
Conference  Series  in  Applied  Mathematics,  SIAM,  to  appear. 


Referenced  papers  - continued 


[50]  Hurt,  J.,  Some  stability  theorems  for  ordinary  difference 
equations..-  SIAM  J.  Numer.  Anal./  4(1967)/  pp.  582-596. 

[51]  LaSalle,  J.  P.,  Stability  of  Difference  Equations.  A Study 
:.n  Ordinary  Differential  Equations  (j.  K.  Hale,  ed. ) , Studies 
in  Mathematics  Series,  American  Mathematical  Association, 

to  appear. 


[1]  ARTSTEIN , Z. 

The  limiting  equations  of  nonautonomous  ordinary 
differential  equations,  to  appear  Journal  of 
Differential  Equations. 

[2]  BANKS,  H.T.  (with  J.  Burns) 

Hereditary  control  problems:  Numerical  methods  based 

on  averaging  approximations,  to  appear. 

[3]  BANKS,  H.T.  (with  J.A.  Burns,  E.M.  Cliff  and  P.R.  Thrift) 

Numerical  solutions  of  hereditary  control  problems  via 
an  approximation  technique.  Lefschetz  Center  for 
Dynamical  Systems  Technical  Report  75-6,  October  1975. 

[4]  BANKS,  H.T.  (with  Paul  Palatt) 

Mathematical  Modeling  in  the  Biological  Sciences. 

Lefschetz  Center  for  Dynamical  Systems  Lecture  Notes, 

75-1,  June  1975. 

[5]  BANKS,  H.T. 

Modeling  and  Control  in  the  Biomedical  Sciences. 

Lecture  Notes  in  Biomathematics,  Vol.  6,  pp.  114, 
Springer-Verlag,  1975. 

[6]  BANKS,  H.T.  (with  J.A.  Burns) 

Projection  Methods  for  Hereditary  Systems.  Dynamical 
Systems,  An  International  Symposium,  Vol.  I,  pp.  287-295, 
Academic  Press,  Inc.,  1976. 

[7]  BRAUN,  M. 

Numerical  Studies  of  an  Area  Preserving  Mapping. 

Dynamical  Systems,  An  International  Symposium,  Vol.  II, 
pp.  37-39,  Academic  Press,  Inc.,  1976. 

[8]  FALB,  P.L.  (with  W.A.  Wolovich) 

Invariants  and  canonical  forms  under  dynamic  compensation, 
to  appear  in  the  SIAM  J.  on  Control. 

[9]  FALB,  P.L.  (with  W.A.  Wolovich) 

Invariants  and  canonical  forms  under  state  feedback,  to 
appear  SIAM  J.  on  Control. 


_ **  ■ 


110] 

111] 

[12] 

[13] 

[14] 

[15] 

[16] 

[17] 

[18] 

[19] 

[20] 


IV-2 


FLEMING,  W.H.  (with  C.P.  Tsai) 

Nonlinear ly  perturbed  stochastic  linear  regulators. 
Presented  at  the  International  Symposium  on  Stochastic 
Systems,  University  of  Kentucky,  June  10,  1975. 

HALE,  J.K. 

Theory  of  Functional  Differential  Equations.  Springer- 
Verlag,  to  be  published  1976-77. 

HALE,  J.K.  (with  H.M.  Rodriques) 

Bifurcation  in  the  duffing  equation  with  independent 
parameters,  submitted  to  the  Proc.  Royal  Society 
Edinburg  - Series  A.' 

HALE,  J.K. 

Restricted  generic  bifurcation.  Presented  at  the  Mathe- 
matical Conference,  Gainesville,  Florida,  March  23-26,  1976 

HALE,  J.K.  (with  P.  Martinez-Amores) 

Stability  in  neutral  equations,  to  appear  in  the  Journal 
of  Nonlinear  Analysis  Theory,  Methods  and  Applications. 

HALE,  J.K. 

Discrete  dissipative  processes.  Presented  at  the  Con- 
ference on  Ordinary  and  Partial  Differential  Equations, 
University  of  Dundee,  March  30  - April  2,  1976. 

KUSHNER,  H.J.  . 

General  convergence  results  for  stochastic  approximations 
via  weak  convergence  theory,  to  appear. 

KUSHNER,  H.J. 

Approximations  for  stochastic  functional  differential 
equations,  to  appear. 

KUSHNER,  H.J. 

Approximation  techniques  for  optimal  stopping  problems 
with  diffusion  models,  to  appear. 

LASALLE,  J.P. 

New  stability  results  for  nonautonomous  systems. 

Presented  at  the  Dynamical  Systems  Conference, 

Gainesville,  Florida,  March  23-26,  1976. 

LASALLE,  J.Po 

Stability  of  nonautonomous  systems,  to  appear  in  the 
journal  of  Nonlinear  Analysis:  Theory,  Methods,  and 

Applications. 


IV-3 


[21]  LASALLE,  J.P. 

Stability  theory  for  difference  equations.  "A  Study  in 
Ordinary  Differential  Equations"  edited  by  J.K.  Hale, 
Studies  in  Mathematics  Series,  Amer.  Math.  Society,  to 
appear. 

[22]  LASALLE,  J.P. 

Vector  Liapunov  functions.  Bulletin  of  the  Institute  of 
Mathematics,  Academia  Sinica,  Vol.  3,  No.  1,  June  1975, 
pp.  139-150.  60^  Birthday  of  Ky  Fan. 

[23]  LASALLE,  J.P. 

Stability  Theory  and  Invariance  Principles.  Cnapter  5: 
Topological  Dynamical  Systems;  reprinted  from  Dynamical 
Systems,  An  International  Symposium,  Vol.  I,  Academic 
Press,  pp.  211-222,  1976. 

[24]  LASALLE,  J.P.  (with  E.N.  Onwuchekwa) 

An  Invariance  Principle  for  Vector  Liapunov  Functions. 
Dynamical  Systems,  An  International  Symposium,  Vol.  II, 
Academic  Press,  pp.  291-295,  1976. 

[25]  PEARSON,  A.E.  (with  Kuang-Chung  Wei) 

Minimum  energy  control  of  a bilinear  pursuit-evasion 
system,  to  appear. 

[26]  PEARSON,  A.E.  (with  Kuang-Chung  Wei) 

On  the  bilinear  regulator  problem  with  a pursuit-evasion 
application,  to  appear. 

[27]  PEARSON,  A.E. 

Positive  definite  performance  functions  for  parameter 
adaptive  control  problems.  Proceedings  of  the  1975  IEEE 
Conference  on  Decision  and  Control,  Houston,  Texas, 
December  10-12,  1975,  pp.  844-849. 

[28]  PEARSON,  A.E.  (and  W.H.  Kwon) 

On  the  stabilization  of  a discrete  constant  linear  system 
IEEE  Trans,  on  Automatic  Control,  December  1975, 

pp.  800-801. 


V-l 


SECTION  V 

V.  LIST  OF  PUBLICATIONS 
LEFSCHETZ  CENTER  FOR  DYNAMICAL  SYSTEMS 

June  1/  1975  - May  31,  1976 


If?' 


[1]  ARTSTEIN,  Zvi 

Limiting  equations  and  stability  of  nonautonomous  ordinary 
differential  equations.  Invited  address  at  the  NSF-CBMS 
Conference  on  the  Stability  of  Dynamical  Systems,  Theory 
and  Applications,  Mississippi  State  University, 

August  1975,  to  appear  in  the  Proceedings. 

[2]  ARTSTEIN,  Zvi 

Topological  dynamics  of  an  ordinary  differential  equation, 
to  appear  in  the  Journal  of  Differential  Equations. 

[3]  ARTSTEIN,  Zvi  (with  E.F.  Infante) 

On  the  asymptotic  stability  of  oscillators  with  unbounded 
damping,  to  appear  in  the  Quarterly  of  Applied  Mathematics. 

14]  ARTSTEIN,  Zvi 

The  limiting  equations  of  nonautonomous  ordinary  differential 
equations,  to  appear  in  the  Journal  of  Differential 
Equations. 

[5]  ARTSTEIN,  Zvi  . 

On  continuous  dependence  of  fixed  points  of  condensing  maps. 
Dynamical  Systems,  An  International  Symposium,  pp.  73-75, 
Academic  Press,  Inc.,  1976. 

[6!  ARTSTEIN,  Zvi  (with  R.  Vitale) 

A strong  law  of  large  numbers  for  random  compact  sets. 

The  Annals  of  Probability,  vol.  3,  no.  5,  pp.  879-882,  1975. 

17]  ARTSTEIN,  Zvi  (with  J.A.  Burns) 

Integration  of  compact  set-valued  functions.  Pacific 
Journal  of  Mathematics,  vol.  58,  no.  2,  1975,  pp.  297-307. 

18]  ARTSTEIN,  Zvi 

Weak  convergence  of  set-valued  functions  and  control. 

SIAM  Journal  on  Control,  vol.  13,  no.  4,  pp.  865-878,  1975. 

[9]  ARTSTEIN,  Zvi 

Continuous  dependence  on  parameters:  On  the  best  possible 

results.  Journal  of  Differential  Equations,  vol.  19,  no.  2, 
pp.  214-225,  November  1975. 


r 


HO] 

[11] 

[12] 

[13] 

[14] 

[15] 

[16] 

[17] 

[18] 


V-2 


BANKS,  H.T. 

Approximation  methods  for  optimal  control  problems  with 
delay-differential  systems.  Oeminaires  IRIA  analyse  et 
controle  de  systemes , Rocquencourt,  1976  (to  appear). 

BANKS,  H.T.  (with  J.  Burns) 

Hereditary  control  problems:  Numerical  methods  based  on 

averaging  approximations,  to  appear. 

BANKS,  H.T.  (with  J.A.  Burns,  E.M.  Cliff  and  P.R.  Thrift) 

Numerical  solutions  of  hereditary  control  problems  via 
an  approximation  technique.  Lefschetz  Center  for 
Dynamical  Systems  Technical  Report  75-6,  Brown  University, 
Providence , R. I . . 


BANKS,  H.T.  (with  Paul  Palatt) 

Mathematical  Modeling  in  the  Biological  Sciences.  Lefschetz 
Center  for  Dynamical  Systems  Lecture  Notes,  75-1,  Brown 
University,  Providence,  R.I.. 


BANKS,  H.T. 

Modeling  and  Control  in  the  Biomedical  Sciences.  Lecture 
Notes  in  Biomathematics,  Vol.  6,  Springer-Verlag,  pp.  114, 
1975. 


BANKS,  H.T.  (With  R.P.  Miech) 

Mathematical  models  for  enzyme  cascades.  Seminaires  IRIA 
analyse  et  controle  de  systemes,  Rocquencourt,  pp.  5-13, 
1975. 


BANKS,  H.T.  (With  K.J.  Almquist) 

A theoretical  and  computational  method  for  determining 
optimal  treatment  schedules  in  fractionated  radiation 
therapy.  Mathematical  Biosciences  29,  159-179(1976). 

BANKS,  H.T.  (with  J.A.  Burns) 

Projection  methods  for  hereditary  systems.  Dynamical 
Systems,  An  International  Symposium,  Vol.  I,  pp.  287-295, 
Academic  Press,  Inc.,  1976. 

BIBIKOV,  Yuri  N. 

Local  Theory  of  Non-Linear  Analytic  Ordinary  Differential 
Equations.  Springer-Verlag  (to  be  published). 


forcing  terra.  Presented  at  the  Dynamical  Systems 
Conference,  Gainesville,  Florida,  March  24-26,  197C. 


[20]  BRA tii,’,  M. 

Differential  Equations  and  Their  Applications.  Springer- 
Verlag,  Mathematical  Sciences  Series,  August  1975. 

[21]  BRAUN,  M. 

Numerical  studies  of  an  area  preserving  mapping.  Dynamical 
Systems,  An  International  Symposium,  Vol.  II,  pp.  37-39, 
Academic  Press,  1976. 

[22]  CLAEYSSEN,  J.R. 

Effect  of  delays  on  functional  differential  equations. 
Journal  of  Differential  Equations,  20,  pp.  404-440,  1976. 

[23]  DAFERMOS,  C.M. 

Almost  periodic  processes  and  almost  periodic  solutions  of 
evolution  equations,  to  appear. 

[24]  DAFERMOS,  C.M. 

Contraction  semigroups  and  trend  to  equilibrium  in 
continuum  mechanics.  Springer-Verlag,  Lecture  Notes  in 
Mathematics,  to  appear. 

[25]  DAFERMOS,  C.M.  (with  R.J.  DiPerna) 

The  Riemann  problem  for  certain  classes  of  hyperbolic 
systems  of  conservation  laws.  Journal  of  Differential 
Equations,  vol.  20,  no.  1,  January  1976,  pp.  90-114. 

[26]  FALB,  P.L.  (with  W.A.  Wolovich) 

Invariants  and  canonical  forms  uiider  dynamic  compensation, 
to  appear  in  the  SIAM  J.  Control. 

[27]  FALB,  P.L.  (with  W.A.  Wolovich) 

Invariants  and  canonical  forms  under  state  feedback,  to 
appear  in  SIAM  J.  Control. 

[28]  FLEMING,  W.H. 

Generalized  solutions  in  optimal  stochastic  control. 
Presented  at  the  Second  Kingston  Conference  on  Differential 
Games  and  Control  Theory,  June  1976. 


V-4 


[29]  FLEMING,  W.H.  (with  C.P.  Tsai) 

Nonlinear ly  perturbed  stochastic  linear  regulators. 

Presented  at  the  International  Symposium  on  Stochastic 
Systems,  University  of  Kentucky,  June  10,  1975. 

[30]  FLEMING,  W.H. 

A selection-migration  model  in  population  genetics. 

J.  Math.  Biology,  2(3),  pp.  219-233,  1975. 

[31]  FLEMING,  W.H. 

Some  stochastic  systems  depending  on  small  parameters. 
Dynamical  Systems,  An  International  Symposium,  Vol.  I, 
Academic  Press,  Inc.  1976,  pp.  103-114. 

[32]  HALE,  J.K. 

Theory  of  Functional  Differential  Equations.  Springer- 
Verlag,  1976-77  (to  be  published). 

[33]  HALE,  J.K.  (with  H.M.  Rodriques) 

Bifurcation  in  the  Duffing  equation  with  independent 
parameters,  to  appear  in  the  Proceedings  of  the  Royal 
Society  Edinburgh,  Series  A. 

[34]  HALE,  J.K. 

Restricted  generic  bifurcation.  Presented  at  the 
Mathematical  Conference,  Gainesville,  Florida,  March  23-26, 
March  23-26,  1976. 

[35]  HALE,  J.K.  (with  P.  Martinez-Amores) 

Stability  in  neutral  equations.  J.  Nonlinear  Analysis 
Theory,  Methods  and  Applications  (to  appear) . 

[36]  HALE,  J.K. 

Discrete  dissipative  processes.  Presented  at  the  Conference 
on  Ordinary  and  Partial  Differential  Equations,  University 
of  Dundee,  Scotland,  March  30,  April  4,  1976. 


[37]  HALE,  J.K. 

Bifurcation  with  several  parameters.  Presented  at  the 
7th  International  Conference  on  Nonlinear  Oscillations, 
Humboldt  University,  West  Germany,  September  8-13,  1975. 

[38]  HALE,  J.K. 

Some  remarks  and  problems  in  functional  differential 
equations.  Lectures  given  at  the  University  of  Sao  Paulo, 
Sao  Carlos,  Brasil,  July  1975. 


[39] 

[40] 

[41] 

[42] 

[43] 

[44] 

[45] 

[46] 

[47] 

[48] 


V-5 


HALE,  J.K.  (.with  Shui-Nee  Chow  and  J.  Mallet-Par et) 

Applications  cf  generic  bifurcation,  II.  Archives  for 
Rational  Mechanics  and  Analysis  (to  appear) . 

HALE,  J.K.  (with  Shui-Nee  Chow  and  J.  Mallet-Paret) 

Applications  of  generic  bifurcation,  I.  Archives  for 
Rational  Mechanics,  vol.  59,  no.  2,  1975,  pp.  159-188, 

1975. 

HALE,  J.K. 

Functional  Differential  Equations  of  Neutral  Type. 

Chapter  4:  Functional  Differential  Equations,  reprinted 

from  Dynamical  Systems,  Vol.  I,  An  International  Symposium, 

1976,  Academic  Press,  Inc.,  pp.  179-194. 

HALE,  J.K.  (with  Waldyr  Oliva) 

One-to-oneness  for  linear  retarded  functional  differential 
equations.  Journal  of  Differential  Equations,  vol.  20, 
no.  1,  January  1976,  pp.  28-36. 

INFANTE,  E.F.  (with  J.A.  Walker) 

On  the  behavior  of  linear  undamped  elastic  systems  perturbed 
by  follower  forces.  Presented  at  the  International  Symposium 
on  Dynamical  Systems,  Gainesville,  Florida,  March  1976. 

INFANTE,  E.F.  (with  J.L.  Stein) 

Does  Fiscal  Policy  Matter?  J.  Monetary  Policy  (to  appear) . 

INFANTE,  E.F.  (with  J.A.  Walker) 

On  the  stability  of  an  operator  equation  modeling  nuclear 
reactors  with  delayed  neutrons.  Quarterly  of  Applied 
Mathematics  (to  appear) . 

INFANTE,  E.F.  (with  J.  A.  Walker) 

Some  results  on  the  precompactness  of  orbits  of  dynamical 
systems.  Journal  of  Mathematical  Analysis  and  Applications, 
vol.  51,  no.  1,  pp.  56-67,  July  1975. 

KUSHNER,  H.J. 

Asymptotic  error  rates  for  sequential  Monte  Carlo 
optimization  methods  (in  preparation) . 

KUSHNER,  H.J. 

Probability  Methods  for  Approximations  in  Stochastic 
Control  and  for  Elliptic  Equations.  Academic  Press 
(to  be  published). 


[49] 

[50] 
[513 

[52] 

[53] 

[54] 

[55] 

[56] 

[57] 

[58] 


V-6 


KUSHNER,  H.J. 

General  convergence  results  for  stochastic  approximations 
via  weak  convergence  thee.  .*  (to  appear). 

KUSHNER,  H.J. 

Approximations  for  stochastic  functional  differential 
equations  (to  appear) . 

KUSHNER,  H.J. 

Approximation  techniques  for  optimal  stopping  problems 
with  diffusion  models  (to  appear) . 

LASALLE,  J.P. 

New  stability  results  for  nonautonomous  systems. 

Presented  at  Conference  on  Dynamical  Systems,  Gainesville, 
Florida,  March  24-26,  1976. 

LASALLE,  J.P. 

Stability  of  nonautonomous  systems.  Journal  of  Nonlinear 
Analysis,  Theory,  Methods,  and  Applications  (to  appear). 

LASALLE,  J.P. 

Stability  theory  for  difference  equations.  To  appear  in 
"A  Study  in  Ordinary  Differential  Equations"  edited  by 
J.K.  Hale,  Studies  in  Mathematics  Series,  American 
Mathematical  Society. 

LASALLE,  J.P. 

Vector  Liapunov  functions.  Bulletin  of  the  Institute  of 
Mathematics,  Academia  Sinica,  vol.  3,  no.  1,  pp.  139-150, 
June  1975. 

LASALLE,  J.P. 

The  stability  of  dynamical  systems.  CBMS  Lecture  Notes  for 
Series  in  Mathematics,  December  1975  (to  appear  in  SIAM  J. 
Control) . 

LASALLE,  J.P. 

Control  theory  (to  appear. ) . 

LASALLE,  J.P. 

Solomon  Lefschetz  - A Memorial  Address.  Dynamical  Systems, 
Vol.  I,  Academic  Press,  Inc.  pp.  XVii-XXi,  1976. 


V-7 


*■ 


[59] 

[60] 

[61] 

[62] 

[63] 

[64] 

[65] 

[66] 

[67] 

[68] 

[69] 


LASALLE,  J.P. 

Stability  Theory  and  Invariance  Principles.  Chapter  5: 
Topological  Dynamical  Systems;  reprinted  from  Dynamical 
Systems,  Vol.  I,  An  International  Symposium,  Academic 
Press,  Inc.  pp.  211-222,  1976. 

LASALLE,  J.P.  (with  E.N.  Onwuchekwa) 

An  invariance  Principle  for  Vector  Liapunov  Functions. 
Dynamical  Systems,  An  International  Symposium,  Vol.  II, 
Academic  Press,  Inc.,  pp.  291-295,  1976. 

MALLET-PARET,  J.  (with  Shui-Nee  Chow) 

Fuller's  index  and  global  Hopf's  bifurcation  (to  appear). 

MALLET-?.1* RET , J.  (with  Shui-Nee  Chow) 

Integral  averaging  and  bifurcation.  Journal  of  Differential 
Equations  (to  appear) . 

MALLET-PARET,  J. 

Generic  periodic  solutions  of  functional  differential 
equations.  Journal  of  Differential  Equations  (to  appear) . 

MALLET-PARET,  J. 

Generic  properties  of  retarded  functional  differential 
equations.  Bull.  Amer.  Math.  Soc.  81,  pp.  750-752,  1975. 

MARTINEZ-AMORES,  P. 

Periodic  solutions  for  coupled  systems  of  differential- 
difference  and  difference  equations.  J.  Nonlinear 
Analysis  Theory,  Methods  and  Applications  (to  appear) . 

PEARSON,  A. I',  (with  Kuang-Chung  Wei) 

Minimum  energy  control  of  a bilinear  pursuit-evasion 
system  (to  appear) . 

PEARSON,  A.E.  (with  Kuang-Chung  Wei) 

On  the  bilinear  regulator  problem  with  a pursuit-evasion 
application  (to  appear) . 

PEARSON,  A.E. 

Positive  definite  performance  functions  for  parameter 
adaptive  control  problems.  Proceedings  of  the  1975  IEEE 
Conference  on  Decision  and  Control,  Houston,  Texas, 

December  10-12,  1975,  pp.  844-849. 

PEARSON,  A.E.  (with  W.h.  Kwon) 

On  the  stabilization  of  a discrete  constant  linear  system. 
IEEE  Transactions  on  Automatic  Control,  December  1975, 
pp,  800-801. 


V-8 


[70]  PLAUT/  R.H. 

Post-buckling  behavior  of  a double  pendulum  with  partial 
follower  load  (to  appear) . 

[71]  PLAUT,  R.H. 

Convexity  properties  and  bounds  for  a class  of  linear 
autonomous  mechanical  systems.  Dynamical  Systems,  An 
International  Symposium,  Vol.  II,  pp.  279-283,  Academic 
Press,  Inc.,  1976. 

[72]  SOMOLINOS,  A. 

Stability  of  Lurie-type  functional  equations.  Journal  of 
Differential  Equations  (to  appear) . 

[73]  SOMOLINOS,  A. 

A generalization!  <&£  the  prob.'  em  of  Lurie  to  functional 
equations  (to  appear).  '•  v < 

[74]  SOMOLINOS,  A. 

Stability  of  Lurie-type  nonlinear  equations  (to  appear) . 


~~*SeCU*JTr  CLAV-ifJC*  ri 


Pnt+r+d) 


REPORT  DOCUMENTATION  PACE 


1.  REPORT  NUMBER 


AFOSR-TR.  76-  108  8 


* «vt  n:auw«  ho 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


1-  RECIPIENT'S  catalog  number 


4.  TITLE  (end  Submit) 


V Tr»C  or  NtAORT  A RCNOO  COVERED 


CONTROL  OF  DYNAMICAL  SYSTEMS  \S  " 


Pinal 


PCRrOMMNO  OMO-  RCPOMT  numHR 


J.  P.  LaSalle 
E.  F.  Infante 


AFOSR  71-2078 


• . PERFORMING  ORGANIZATION  N AM  E AND  ADDREV6 


Brown  University 

Lefschetz  Center  for  Dynamical  Systems  i/ 
Providence,  Rhode  Island  02912 


PROORAM  ELEMENT,  PROJECT,  TASK 
AREA  * WORK  UNIT  NUMBERS 


61102F 

9769-01 


11.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 


Air  Force  Office  of  Scientific  Research  (NM) 
Bolling  AFB,  DC  20332  “ 


12.  REPORT  DATE 

30  Jul  76 


4.  MONITORING  AGENCY  name  ft  AOORESSfU  dlllerent  Iran  Controlling  Ollier) 


13.  NUMBER  OF  PAGES 

50 


IS.  SECURITY  CLASS,  (el  thin  report) 


UNCLASSIFIED 


ISft.  OECLASSIFICATION/  DOWNGRADING 
SCHEDULE 


16.  DISTRIBUTION  STATEMENT  (0/  (Ilia  Report) 


Approved  for  public  release;  distribution  unlimited. 


17.  DISTRIBUTION  STATEMENT  (ol  the  abatrect  entered  In  Block  30,  II  dlllmrenl  Item  Report) 


he  problem  of  arbitrarily  assigning  closed  loop  poles  of  a linear  multivariable 
system  developed  a new  method,  a generalization  of  the  classical  root  locus  metho 
Studies  have  also  been  conducted  on  the  attainment  to  stable  solutions  of  model 
matching  problems.  A technique  mas  developed,  based  on  a modified  minimal  energy 
regulator  problem,  to  obtain  feedback  stabilization  of  linear  time  varying 
differential  systems.  Two  methods  of  parameter  identification  for  linear 
differential  systems  were  developed.  A study  was  made  of  bilinear  control  system 
with  applications  to  parachute  gliding  systems  and  the  pursuit-evasion  missile. * 


.JAN  73  1473  COITION  or  * NOV  IS  OBSOLETE 


UNCLASSIFIED 


SCCUKtTY  CL ASSir (CATION  or  tmii  pack  nr* 


ff&JfttTV  CLASSIFICATION  OF  THIS  PAGt(Whm  Of  SmwQ 


20.  Abstract  (Continued) 


I control  problem.  Studies  were  made  of  linear  operator  feedback  for  the 
i compensation  and  control  of  multivariable  systems.  A number  of  computational 
methods  and  techniques  for  control  problems  with  diffusion  models  were  developed 
* in  addition  to  the  study  of  the  application  of  Monte  Carlo  methods  for  the 
optimization  of  constrained  noisy  systems.  The  study  of  bifurcation  problems 
htn  been  pursued  from  the  abstract  viewpoint  and  for  specific  applications. 
Studies  were  continued  for  systems  described  by  ordinary  and  functional 
different lax  equations. 


